JOURNAL OF MbX CLASS FILES, VOL. 6, NO. 1, JANUARY 2007 



1 



Negative /^-encoder 

Tohru Kohda, Member, IEEE, Satoshi Hironaka, and Kazuyuki Aihara 



0^ 
O 
O 



00 



> 
00 

00 

o 

00 

o 



X 



Abstract — A new class of analog-to-digital (A/D) and digital- 
to-analog (D/A) converters using a flaky quantiser, called the 
/3-encoder, has been shown to have exponential bit rate accuracy 
while possessing a self-correction property for fluctuations of 
the amplifier factor /3 and the quantiser threshold v. The 
probabilistic behavior of such a flaky quantiser is explained as 
the deterministic dynamics of the multi-valued Renyi map. That 
is, a sample x is always confined to a contracted subinterval while 
successive approximations of x are performed using /3-expansion 
even if v may vary at each iteration. This viewpoint enables 
us to get the decoded sample, which is equal to the midpoint 
of the subinterval, and its associated characteristic equation for 
recovering f} which improves the quantisation error by more 
than 3dB when f} > 1.5. The invariant subinterval under the 
Renyi map shows that ly should be set to around the midpoint 
of its associated greedy and lazy values. Furthermore, a new 
A/D converter is introduced called the negative (3 -encoder, which 
further improves the quantisation error of the /3-encoder. A two- 
state Markov chain describing the /3-encoder suggests that a 
negative eigenvalue of its associated transition probability matrix 
reduces the quantisation error. 

Index Terms — Analog-to-digital (A/D) conversion, flaky quan- 
tiser, /3-expansion, /3-encoder, chaotic dynamics, PCM, EA mod- 
ulation, Markov chain. 



I. Introduction 

SAMPLING and quantisation are necessary in almost all 
signal processing. The combined operations are called 
analog-to-digital (A/D) conversion. Since A/D converters are 
analog circuits, they have the fundamental problem that in- 
stability of the circuit elements degrades the A/D conversion. 
There are a number of possible remedies to cope with this 
problem. 

The standard sampling theorem states that if a band-limited 
signal f{t) is sampled at rates far above the Nyquist rate, 
called oversampling, then it can be reconstructed from its 
samples, denoted by {f{ — )}nez (with M > 1), by the use 
of the following formula with an appropriate function ip(t). 



fit) 



1 ^ \ 



(1) 



The above formula does not result in a loss of information. 
However, since the amplitudes of the samples are continuous 
variables, each sample is quantised according to amplitude into 
a finite number of levels. This quantisation process necessarily 
introduces some distortion into the output. The magnitude of 
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this type of distortion depends on the method by which the 
quantisation is performed. 

Various kinds of A/D and digital-to-analog (D/A) conver- 
sions have been proposed. Related topics include one-bit cod- 
ing through over-sampled data |4| and high-quality AD con- 
versions using a coarse quantiser together with feedback (]5], 
the concept of ''democracy" |6|, in which the individual bits 
in a coarsely quantised representation of a signal are all given 
"equal weight" in the approximation to the original signal, a 
pipelined AD converter |7|, and a single-bit oversampled AD 
conversion using irregularly spaced samples |3|. 

Given a bandlimited function /, the L-bit pulse code 
modulation (PCM) |8| simply uses each sample value f{n/M) 
with L bits: one bit for its sign, followed by the first L—1 bits 
of the binary expansion of f{n/M). It is possible to show that 
for a bandlimited signal, this algorithm achieves precision of 
order 0(2"^). On the other hand, SA modulation [JJ, [2J, 
0, IfTOl . Iim . another commonly implemented quantisation 
algorithm for a bandlimited function, achieves precision that 
decays like an inverse polynomial in the bit budget L. For 
example, a fcth-order EA scheme produces an approximation 
where the distortion is of the order 0{L^^). Although PCM is 
superior to EA modulation in its level of distortion for a given 
bit budget, EA modulation has practical features for analog 
circuit implementation. One of the key features is a ceratain 
self-correction property for quantiser threshold errors (bias) 
that is not shared by PCM. This is one of several reasons why 
EA modulation is preferred for A/D conversion in practice. 

In 2002, Daubechies et al. \\2\ introduced a new architec- 
ture for A/D converters called the (3-encoder and showed the 
interesting result that it has exponential accuracy even if the /3- 
encoder is iterated at each step in successive approximation of 
each sample using an imprecise quantiser with a quantisation 
error and an offset parameter. Furthermore, in a subsequent 
paper [13], they introduced a "flaky" version of an imperfect 
quantiser, defined as 



Q{ i(-z) = 



0, if z < I'o, 

1, if 2: > 1^1, 
Oorl, if z e (z^o, i^i), 



(2) 



where 1 < vt^ < vi < (/3 — 1)^^ and made the remarkable 
observation that "greedy" and "lazy" as well as "cautious'Q 
expansions in the /3-encoder with such a flaky quantiser exhibit 
exponential accuracy in the bit rate. This /3-encoder was a 
milestone in oversampled A/D and D/A conversions in the 
sense that it may become a good alternative to PCM. The 
primary reason is that the /3-encoder consists of an analog 
circuit, with an amplifier with the factor /3, a single-bit 

'intermediate expansions (14| between the greedy and lazy expansions are 
called "cautious" by Daubechies et al. |13l. 



JOURNAL OF MbX CLASS FILES, VOL. 6, NO. 1, JANUARY 2007 



2 



quantiser with the threshold v and a single feedback loop 
for successive L-bit quantisation of each sample which uses 
the bit-budget efficiently, like PCM. The /3-encoder further 
guarantees the robustness of both /3 and v against fluctuations 
like SA modulation. Nevertheless, it provides a simple D/A 
conversion using the estimated /3 without knowing the exact 
value of /3 with its offset in the A/D conversion fTSl . 

This paper is devoted to dynamical systems theory for 
studying ergodic-theoretic and probabilistic properties of the 
/3-encoder as a nonlinear system with feedback. We emphasize 
here that the flaky quantiser Q^^(-) is exactly realized by the 
multi-valued Renyi map {i.e., /^-transformation) [201 on the 
middle interval A/5 — [/3^^, /3^^(/3— 1)^^] so that probabilistic 
behavior in the "flaky region" A/3 is completely explained 
using dynamical systems theory. Our purpose is to give a 
"dynamical" version of Daubechies et al.'s proof for the 
exponential accuracy of the /3-encoder as follows. We can 
observe that a sample x is always confined to a subinterval 
of the contracted interval defined in this paper while the 
successive approximation of x is ifafeZ}!^ performed using /3- 
expansion even if ly may vary at each iteration. This enables 
us to obtain the decoded sample easily, as it is equal to the 
midpoint of the subinterval, and it also yields the characteristic 
equation for recovering f3 which improves the quantisation 
error by more than 3dB over Daubechies et al. 's bound when 
/3 > 1.5. Furthermore, two classic /3-expansions, known as 
the greedy and lazy expansions are proven to be perfectly 
symmetrical in terms of their quantisation errors. The invariant 
subinterval of the Renyi map further suggests that v should 
be set to around the midpoint of its associated greedy and 
lazy values. This paper presents a radix expansion of a real 
number in a negative real base, called a negative ^-expansion 
and a negative (3-encoder in order to make stable analog circuit 
implementation easier Finally we observe a clear difference 
between a sequence of independent and identically distributed 
(i.i.d.) binary random variables generated by PCM and a binary 
sequence generated by the /3-encoder based on the viewpoint 
that if the latter sequence is regarded as a 2-state Markov chain 
with a 2 X 2 transition probability matrix, then the matrix has 
a negative eigenvalue. 

First, we survey PCM from the viewpoint of dynamical 
systems because it is a typical example of a nonlinear map. 
PCM is an A/D converter that realizes binary expansion in the 
analog world. The binary expansion of a given real number 
r G [—1,1] has the form 



(3) 



where &o,b — ^o,b(?') G {^1,1} is the sign bit, and bi s = 
bi,B{f) G {0, 1} i > 1 are the binary digits of |r|. We define 
the quantiser function Qi{-) as 



Qi{x) 



0, 
1, 



X < 1, 
a; > 1. 



(4) 



small real-valued quantity, approximately proportional to the quantisa- 
tion error, does not necessarily converge to any fixed value, e.g., but may 
oscillate without diverging as discussed later in detail. Such a phenomenon 
is sometimes referred to as chaos. 



Then we have bi_B which can be computed by the following 
algorithm. Let ui — 2|r|; the first bit hi B is then given by 
bi,B = Qi{ui). The remaining bits are determined recur- 
sively: if Ui and bi^s have been given, then we can define 



and 



bi+i,B — Qi{ui+i), 



(5) 



(6) 



respectively. Such a sequence is also obtained with the 
BernoulH shift map B(a;) QH, |[T7l, JTSl, defined by 

Bix) . 2. mod 1 = { ^ I < (7) 

and its associated bit sequence 6;. 5(1 = 1,2,.. .), defined by 

_ r 0, B^-\x) < 1/2, 
''^■^ - \ 1, B^-Hx) > 1/2. 

Iterating B{x) for x £ [0, 1) gives 

B'+\x) = 2B'{x) ~ b,^B, i = 1, 2, • • • , L e N. (9) 

Then 

= 2{---2{2x~bi,B)-b2.B---)-bL,B 

L 

= 2^x-^&,,b2^-* (10) 



1=1 



or 



^6,,b2-* + 2-^S^(x). 



(11) 



Hence 2 ^B^{x) = as L 00 because B^{x) e [0,1). 
That is, we get the binary expansion of x: 



Y.^^.B2- 



(12) 



Suppose that a threshold shift p occurs. Let Bp{x) be the 
resulting map: 

5(^)_f2x, x<(l + p)/2, 
^P^'^'-X 2x-l, x> (l + p)/2, 

and bi,Bp{i = 1, 2, . . .) its bit sequence: 

_ r 0, B^-\x)<{l + p)/2, 
^''^^-\ 1, Bl-\x)>{l + p)/2. (14) 

Then we have its associated binary expansion of x, defined as 

L 

^ = ^ks,2-' + 2-^B^(a;). (15) 

4=1 

When p > 0, we have Bp{x) : [0, 1) [0, l+p) for x e [0, 1). 
Iterating Bp{x) L times gives B^{x) : [0, 1) [0, 1-1-2^" V)- 
Thus we have 



0<x-^6,,B,2-*<2-^ + ^. 



(16) 
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Conversely, suppose that p < 0; then we get Bp{x) : [0, 1 
[0, 1) [2^^ Vi 1) which implies that 



[p, 1) for X e [0, 1). Iterating Bp{x) L times gives Bp{x) 



L 



< 0. 



(17) 



Both ( fT6l ) and (fTTI l show that an A/D conversion does not 
work well because the quantisation errors don't decay. Figure 
[U shows the divergence of a value x in PCM when there is a 
threshold shift p > 0. Such a map must be a mapping interval 
into interval (or at least a mapping interval onto interval) so 
that the A/D conversion operates normally. Fluctuations of 
the threshold are inevitable because every A/D converter is 
implemented as an analog circuit. 

However, /^-encoders which realize ^-expansion using the 
expansion by /3 e (1,2) as a radix, overcome this problem. 
The block diagram of the /3-encoder is shown in Fig|2] with 
the amplifier /3 E (1,2) and the quantiser Q^. The quantiser 
is defined by 



0, 
1, 



X < I', 

x> v. 



(18) 



Note that the /3-encoder with /5 = 2 and v = 1 provides the 
PCM. The bit sequences hi^p can be calculated recursively 
as follows. Let ui — f3x; the first bit bi^js is then given by 
&i,/3 = Qu{ui). The remaining bits are obtained recursively; 
given Ui and bi^p, we define Ui+i = f3{ui — bi^0) and bi+i,/} = 
Quiui+i). Daubechies et al. |[12|, |[l3, |[l5l introduced the 
flaky quantiser, defined by Eq.(|2]l and gave the important result 
that the /3-encoder can perform normally and has exponential 
accuracy even if the quantiser threshold v fluctuates over the 
interval [1, {l3 - 1)-^]. 

II. Basics of dynamical systems theory 

We deal exclusively with the asymptotic behavior exhibited 
by a dynamical system. In particular, we limit ourselves to a 
map of an interval /, called an interval map ifTTll . ifTSll . The 
following short review of the fundamentals fl^ is provided 
to explain the dynamics of the /3-maps. 

Given E ClM. and the continuous map t : E E, the set 
E and the map r form a dynamical system, denoted by {E, t). 





Fig. 2. A /3-encoder: for input zq = y a [0, 1), = 0, i > 1, and "initial 
conditions" uq = and feo,/3 = 0, the output {bi f})i-^i gives the /3-expansion 
for y defined by the quantiser Qi, = Q\ {■ /v), with v S [1, (/3 — This 
provides the "greedy" and "lazy" schemes for v = 1 and v = (P — , 
respectively. The /3-encoder with (3 = 2 and u = 1 gives PCM. 



For a given a; G / a sequence of forward iterates 

X,T{x)y{x)=T{T{x)),T\x)^T{T{T{x))),... (19) 

is referred to as the forward trajectory (or orbit) of x. We 
can F d E invariant if t{F) C F. We cafl f : Ei ^ E2 
a homeomorphism if / is one-to-one and both / and /^^ 
are continuous. If, in addition, / is onto, we call / an onto 
homeomorphism. Let f : A ^ A and g : B ^ B he given. 
We say that / and g are topologically conjugate if there is an 
onto homeomorphism h : A ^ B such that ho f = g o h. The 
homeomorphism h is called the conjugacy between / and g. 
We say that a map r with its invariant subinterval J is locally 
eventually onto if for every e > there exists M E N such 
that, if U is an interval with \U\ > e and if n > M, then 
t"(C/) = J. 

One of the main problems in dynamical systems theory is 
to describe the distribution of orbits. That is, we wish to know 
how the iterates of points under an interval map vary over the 
interval. Ergodic theory provides answers to such questions, 
particularly the notions of the ergodicity and the invariant 
measure. Let /i be an absolutely continuous invariant measure 
for the map r, then we have the following theorem. 
Birchoff Ergodic theorem: ifTTl. ifTSl. |fT9l 
(i) Let T be a measure preserving map of an interval /. 
Then for any integrable function h{x), the time average 
1 - 

h{T'{x)) exists for almost all x E I with respect 



Fig. 1. The divergence of a value x in PCM when there is a threshold shift 
p > 0. 



lim — / 

N^oo N 

i=0 

to /z. 

(ii) If, in addition, r is ergodic, then the time average is equal 
to the space average J hd^ for almost every x with respect 

to /i. 

The first important result on the existence of an absolutely 
continuous invariant measure is now considered to be a 
folklore theorem which originated with the basic result due 
to Renyi |j20|. His key idea has been used in more general 
proofs by Adler and Flatto[21 1. 

Definition 1 Let I be an interval and {Ii} be a finite 
partition of I into subintervals. Let t : I I satisfy the 
following conditions: 

1) piecewise smoothness, i.e., rj/. has a C^-extension to 
the closure Ii of Ii. 

2) local invertibility, i.e., r|/. is strictly monotonous. 

3) Markov property, i.e., T{Ii) = union of several Ij. 

4) Aperiodicity, i.e., there exists an integer p such that 
TP(li) ^Ifor all i. 

If l)-3) hold, then {Ii} is called a Markov partition for t (or 
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r is a Markov map for {li})- El 

Condition 4) is added to ensure that the following theorem 
holds. 

Folklore theorem: Assume that l)-4) hold and that r is even- 
tually expansive, i.e., for some iterate r", \dT'^ / dx\ >9>1 
for all X. Then t has a finite Lesbesgue-equivalent measure 
m and furthermore dm — p{x)dx, where p{x) is piecewise 
continuous and < P < D for some D. 

Under conditions l)-4), the converse of the folklore theorem 
also holds. 

III. MULTI- VALUED RENYI MAP AND FLAKY QUANTISER 

The /3-expansion {f3 > 1, f3 ^ Z) is obtained as a 
basis of the /3-encoder according to the classic ergodic the- 
ory Eol, El, EH, ED, El, Ei- Renyl EQI defined the 
/3-transformation: x ^ (3x mod 1 for real numbers x £ (0, 1] 
and /3 > 1. Gelfond ED and Pan-y E3 gave its finite 
invariant measure. Parry 124] defined the hnear modulo one 
transformation (or a)-transformation, a generalized Renyi 
map): x i-^ f3x + a mod 1 for real numbers x E (0, 1] and 
P > 1, < a < 1, and gave a finite invariant measure 
for a (strongly) ergodic linear modulo one transformation as 
follows. 

Parry's result E3, ll24l: /fr is a linear modulo one trans- 
formation (t{x) = fix + a mod 1, /3 > 1, < a < 1), then 

v{E) — I p{x)dx is a finite signed measure invariant under 
Je 

T, where p{x) is an unnormalized density given as 

p{x)=Y. E 7",/or«y^0( [24), (21) 

3;<r"(l) 2;<r"(0) 

with 7 = {3^^. If T is strongly ergodic, then p{x) > for 
almost all x and v is a finite positive measure invariant under 

T. 



Erdos et al. 11251 . 112611 showed that the /3-expansion has 
multiple representations of a real number x G [0, 1)^^) 

L 

as follows. They introduced the lexicographic order < on the 

real sequences: (6^) < (6^) if there is a positive integer m such 
that hi = 6- for all i < m and hm < b'„^. It is easy to verify 
that for every fixed x with 0<x<(/3— l)^^in the set of 
all expansions of x, there exist a maximum and a minimum 
with respect to this order, namely the so-called greedy and lazy 
expansions. The greedy expansions were studied originally by 
Renyi [|20( . where they were called /3-expansions. A number 
X has a unique expansion if and only if its greedy and lazy 
expansions coincide. Erdos et al. defined the bit sequence of 
these expansions recursively as follows: if m > 1 and if the 
bit sequence 6, of the greedy expansion of x is defined for all 
i < m, then we set 



hm — 



1, 

0, 



< X, 



(22) 



If TO > 1 and if the bit sequence bi of the lazy expansion of 
X is defined for all i < m, then we set 



(23) 



Erdos et al. 0261 noted the following duality of the greedy and 
lazy expansions. Given x G [0, (/9— 1)^^), we define ip{x) by 



V'(x) = (/3-l)-i- = 

Using the trivial relation J2i<m bil''+J2i 
J2i<mbil' - 7™' we can rewrite Eq. 



(24) 



0, (/?-l)-i-E.<„J.7'-7'">x, 

1, (/3-l)-i-^^^„J,y-y»<a;, ^ ' 



or 



0, E.<™^7' + 7™<V'(x), 

1> E^<mb^l'+l"'>i'{^), 



(26) 



where bi = 1 — bi. Introducing ~ bi, we get the greedy 
expansion of ^{x): 



(27) 



1. E,<™C,7'^+7"< V^(^), 
0, E,<™C,7^+7'">V'(x), 

which has the dual roles of the greedy expansion {bi} of x 
and the lazy expansion {bi} of x, i.e., the greedy expansion 

{cj of ij{x). 

We now define several different kinds of dynamical systems 
governed by multi-valued Renyi maps on the middle interval 
= [7,7(/3 — 1)^^] that realize Daubechies et al.'s flaky 
quantiser defined by Eq.© as follows. 

Let C/3 i,{x) be the cautious map, shown in FiglSja), defined 

by 



(28) 



which determines the flaky quantiser (■) and 

gives its associated bit sequence {bi ^i }°Zi^ defined by 



0, C},-^\x) < jiy, 

1, C},Jix)>ji.. 



(29) 



Then we get the following cautious expansion of x by the map 

Ci3,„{x) 

m— 1 

^ = E Kc^^j' + 7""'C'^;' (30) 
1=1 

which implies that each x G [0, (/?— has a representation 

Kc% e{0,l} (31) 



i=l 



The Bernoulli shift map is a typical example of a map satisfying l)-4). 



because C™~ {x) = when m oo. The cautious 

expansion map Cp^,y{x), v G (1, (/? — 1)^^) with a unique 
point of discontinuity c = has its strongly invariant 
subinterval \ij — \,v\ because the map C/3 jy(a;) is locally 
eventually onto as shown in FiglS^a). This map defines its 
dynamical system, defined as i^v — 1, j/), C^_j^(a;)), which is 
illustrated by the bold fines in Figl3ja). 
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(a) 



(b) 



Fig. 3. (a) "cou(!o«i"-expansion map |131 : C^,^(a;) for 1 < u < 
which is locally eventually onto u]. Renormalizing the interval [i^— 1, u] 

into the unit interval [0, 1] shows that such a locally eventually onto map is 
equivalent to the Parry's Unear modulo one transformation (or (/3, Q!)-map) 
as shown in (b). 



Let = vi ■ ■ ■ Vi ht an abbreviation for a sequence of i 
thresholds G [1, (/3 - l)-^], 1 < j < i. Let and 
&j Qi be the i-iterated map, recursively defined as 



(32) 

and its associated binary random variable, defined as 



(33) 



respectively. Then the cautious expansion of x by the map 
Cp,^u{x) using the threshold sequence v\ is 



i=\ ' ^ 



i.e., the onto-mapping relation < C^^,, (a;) < (/3 - 
tells us that the sample x is always confined to the ith stage 
subinterval, defined by 

L L 

I 



ti 



(35) 

where successive approximations to x in the /3-expansion are 
performed using i^f . This elementary observation is important 
in discussing the contraction process of the interval by /3- 
expansion. In order to avoid shortcuts in proving the above 
observation, it is worthwhile to discuss the quantiser in two 
different situations separately: the case where a fixed sequence 



Vi — 1 (or Vi — {(3 — 1)~^), 1 < i < L then it is called the 
"steady" greedy (or lazy) expansion, i.e., the classic greedy 
(or lazy) expansion. 

Let Ci3^i{x) be the greedy expansion map, defined by 



f3x, X < J, 



fix — 1, a; > 7, 
and f'i.cj J its associated bit sequence, defined by 



b. 



0, C-/(a;)<7, . 

1, C-i(a:)>7, 



(36) 



(37) 



Then the following is the greedy expansion of x by the map 

C/3,i(^): 

m — 1 

^= E^^Cj.,f +7'"-'C^r'(:^). (38) 

i=l 

Equivalently, we have 

Y.b,,C'^y^x-^"^~^C;;]-\x) (39) 

which enables us to rewrite Eq.(l37ll as follows: 



r 1, c^^\x) > 7, 

I 0, C^-\x) < 7, 



_( 1, x-7™-iC™-i(x)+7™ <2:, 
'"■^^'i \ 0, X- 7''""'C™-\x) + 7™ > X, 

f 1: E^<rnKc'Y+l"'<X, 



\ 0, E.<™^cj,,7'+7'">^. 

This suggests that hm.cj^-^ in Eq. JSTl i is equal to bm in Eq 
Let (a;) be the lazy expansion map defined by 



Px, x<j{P-l)-^ 



i' (40) 



(34) and k 



'i,C' 

defined by 



{i = 1,2,...) its associated bit sequence. 



0, C^('^_i)-i(a;)<7(/3-l)-' 

1. C;:^y,)-i{x)>liP-l) " 



_i (41) 



Then the following is the lazy expansion of x by the map 

C/3,(;3-i)-i(a;): 



2 — 1 

Equivalently, we get 



■v^., V* e[\, (/3- 1) 1] is used and the one where ^^ich enables us to rewrite Eq.gB as follows: 



L times 

a varying sequence i^f ^ vi ■ ■ ■ Vi ■ ■ ■ vl, Vi = i/* (1 + ui) E ^ 
[1, (/3 — 1)^^], 1 < « < i with a bounded random fluctuation 
Ui is used. 

Assume for simplicity that the quantiser threshold v* E 
[1, {(3— 1)^^] is fixed. Let us consider the special case where 



1 1, 



o,c^;^;^^^-^ix)<7{p~lr\ 



'ra,C 
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(a) (b) 



Fig. 4. (a) Greedy-expansion map:C^ 1(2:), whicli is locally eventually 
onto [0,1) and (b) lazy-expansion map: Cp (a;), which is locally 

eventually onto — — 1, (/3 — These multivalued maps on 

the middle interval = [7, 7(/3 — 1)~ ] corresponds exactly to the flaky 
quantiser Qi^(-)- 

;3=1.5, L=16 
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Fig. 5. The MSE(3;^ ql (TiPz,)), < pi, < 2 using the exact /3 of the 
^-encoder with /3 = 1.5, L = 16, and fixed u* 6 [1, (/3 - 1)"^]. 

because X]i>m7' ~ (/^ ~ 1)~^7™. This suggests that 
bm C" in Eq.(l4ni is equal to &,„ in Eq.(|23]). 

' /3,(/3-l)-l 

Let r : / ^ / be an interval map with a unique point of 
discontinuity c such that t(c^) — \imticT{t) is not equal to 
t(c+) = \imt^cT{t). To each a; e / we associate an element 
of {0, 1, by listing the sequence of adresses of the forward 
orbit of X, called the itinerary of x under the map t{x), 
denoted as Sr{x) — (sq, si, • • • , s„, . . .), is defined by: 

( 0, ifT^ (a;) < c, 
Sj^l *, \fT^\x)^c, (44) 
[ 1, ifT^ (a;) > c. 

Let o- : S = {0, *, 1}^ E be the shift map: 

a{Sr) =tr = {tl,t2, ■ ■ ■ ,tn, ■ ■ .), SUCh that U = Si+i. (45) 

We adopt the convention that if, for some j, we have sj — *, 
then we stop the sequence, that is, the itinerary is a finite 
string. Hence, if t"{x) ^ c for all n, then St-{x) £ {0, 1}^. 

Figure |4] (a) (or (b)) shows such a greedy (or lazy) 
expansion map Ci3^i{x) (or (x)) with a unique 

point of discontinuity c = 7 (or c = 7(/3 — 1)^^) which 



corresponds exactly to the flaky quantiser Qj^ (•) 
and also has its strongly invariant subinterval [0, 1) (or {$ — 
1)^^ — — 1)^^)) because of its locally eventually onto- 
mapping. Such a map defines the greedy (or lazy) dynamical 
system, defined as ([0, 1), Cp^i{x)) (or ([(/3 - -!,(/?- 
(a;))) which is illustrated by the bold lines 
in FigH] (a) (or (b)). The strongly invariant subinterval asso- 
ciated with the i-iterated greedy (or lazy) map Cp-^{x) (or 
Cp i^p_^yi{x)), corresponds to the subinterval, defined as 

^rcf:'(^) - [E^^c^,7^E^.c^,7^+7^)' (46) 

(or 

iT^ ix) ^ E Kc;^,,_,_.i' + 7^((/? - 1)-^ - 1), 

i—1 
L 

T.Kc^ .f+i'-iP^iy'))- (47) 

' /3,(3~1)-1 

i—1 

Dajani and Kraaikamp 1 14|, however, discussed the differences 
between the error of the greedy expansion of x, defined as 
7^C^]^(x), and that of the lazy expansion of x, defined as 
7^^/3 (/3-i)-i ^'^'^ concluded that "on average for almost 
all X, the greedy-convergents, defined as X^i^Li ^i.cj ^7*' '^P' 
proximate x 'better' than the lazy-convergents of x, defined 
as yi^i 6, ri 7*-" Furthermore, Daubechies et al. |fT3l 

used xl'^if''"' " "'■ = X;f=i h,c . l\ here called the "small- 
est value of the Lth stage subinterval Ij^ ql (x)", denoted 
by x{j, 0), and defined by 

L 

x{j,0) = Y,Kc^ .7'- (48) 

Such a decoded value, however, works in favour of the greedy 
expansion of a sample x, i.e., ^j,c^ ^T*' which is equal 

to Dajani and Karikaamp's greedy convergent lfT4l if x is 
uniformly and independently distributed over the unit interval 
[0, 1]. This comes from the fact that the strongly invariant 
subinterval of the locally eventually onto-( greedy expansion) 
map Cp-^{x), /"™™"'(a;) is skewed towards the left portion of 

the interval I^^ ql ^(x). 

On the other hand, the "largest value of the Lth stage 
subinterval Ij^ ql (x)", denoted by x{'^, 2), and defined by 

L 

J(7,2)-^6,.c. 7'+7^(/3-l)-i (49) 

works in favour of the "steady" lazy expansion, i.e., 
Si^i ^i,c* J 7*' which is equal to Dajani and 
Karikaamp's lazy convergent, as shown in Fig|5] That is, the 
lazy expansion defines the strongly invariant subinterval of the 
locally eventually onto-(lazy expansion) map (x), 
jinvarmnt which is skcwcd towards the right portion 

of the interval Ir ix). 



JOURNAL OF MbX CLASS FILES, VOL. 6, NO. 1, JANUARY 2007 



7 



Two locally eventually onto Renyi maps, as shown in 
Fig. 3(a) and (b), demonstrate that greedy expansion and lazy 
expansion maps are symmetrical as follows. The lazy expan- 
sion of X and the greedy expansion of iIj{x), respectively 
defined by 



Then 



X — X 



' 13, {13-1)- ^ -^^-^ff.l 

proof: Equations ( l54b and ( fSSl ) immediately yield 



' /3.(/3-l)-l 



^/3,(/3-l)-i(^) 



i,C' 



ip{x) 



L 

E 

1=1 



/3,0-l)-l 



0,03-1)- 



(50) 



ip{x) 



7 



(/3-l)-i 



satisfy the following lemma lfT4l : 

Lemma l:The greedy map C^j^(x) and the lazy map 
Cg (g_i)-i{x) are topologically conjugate, i.e., 



(56) 
,(57) 

(58) 

□ 



which together with Eq.(|53]l completes the proof. 

The invariant subinterval of the L-iterated cautious map 
1)^^) is defined as 



,(a;)) = C^,i(^(x)),LeZ. 
proof: Using Eq.JSOll and c^ c^ = 



(5 us; 



(x) 



L 

E^^cj,, 
1=1 



1 



we get 



^invariant (3,) ^^^^j j. 



invariant 



(59) 
(x). 



L 

-V'(a;) =E(^^.C' 

i=l 



+ c. 



.,cj_,)7' 



+ 7''{C|,(^_i)-i(x)+C^,i(V'(a;))} 

= E 7' + 7'^{C^,(/3-i)-i (a:) + ^1,1(^^(0:))} 
1=1 

v-L+l 



7-7 



+ 7^{C^,(^_i)-i(a:)+C^,i(V'(x))}. 



1-7 

The trivial relation x + ipix) = (/? — 1)^^ = 



gives 



^/5,(/3-l)- 



or 



{x)+C^^^Wx)), LeZ 



(52) 



(53) 



which completes the proof. □ 
This lemma implies that many dynamical properties of the 
greedy dynamical system are preserved by the conjugacy; that 
is, topologically conjugate systems are dynamically the same 
in this sense. □ These two expansions satisfy the following 
strong relation which provides a starting point for this study: 

be the decoded value of x 

' /3,(/3-l)-l 

}f=i, defined by 

|9.(|3-1)-1 



Theorem 1: Let x 

using its lazy expansion {5^ p 



/3,(/3-l)-l 



E^.c 

i=l 



13,(13-1)-^ 



f + 



(54) 



which has as special cases /" 

It is noteworthy that such a map restricted to the invariant 
subinterval with its discontinuous point c = 71^ is the same as 
Parry's (/3, a)-map with its point of discontinuity c = 7(1 — 
a) 1241 . as shown in Fig|3jb), if a = I3{v — 1). 

Throughout this paper, we assume that the forward orbit of a 
point of discontinuity c = jiy, 1 < v < (/3— under the /3- 
expansion map Cp^u{x) is infinite and that c is not attracted 
to a periodic orbit, meaning that there does not exist an n- 
periodic point x such that limfe^oo f^^ (c) — x. Then, the 
binary sequence {h^ governed by Cp^u{x) is exactly 

the itinerary of x under Cp^u{x). 

Remark 1: Let t(-) be the greedy, lazy or cautious dynam- 
ical system, defined as {[0,l),Cp^i{x)), ([(/3- - 1, (/3- 
l)"^),C'/3,(/3-i)-i(a;))) or {[v ~ l,v),Cp^y{x)), respectively 
and M{x) E N the iteration number of a real number 
X e (0,1], called the first visit time to J of x, such that 
T^{x) <^ J, n < M, T^{x) e J, where J is given by [0, 1), 
[(/? - l)-i - 1, (/3 - 1)-^) or [v - 1, ly), respectively. Then 
AI{x) is a random variable depending on x but if x G J, then 
M{x) = 0. 

IV. Interval Partition by /3-map with varying 

Equation ( [30l l, substituting to — 1 by i as well as Eq.([38]l 
(or (|42] |) as special cases, shows that x can be decomposed 
into two terms, the principal term at L bit precision and the 
residue term "f'^Cp (x). This enables us to make the elemen- 
tary observation that x is always confined to the contracted 
subinterval, defined as 



Let 'ip{x) (jL be the decoded value of ip{x) using its greedy / 
expansion {c^ fji^ j}i^i> defined by 



L 

E f^^cj 

i=l 



iIj{x) 



c 7 + 

13,1 



(/3-l)-V 



(55) 



*Let fJ-p^i be the greedy measure whose density is given by p{x) for a = 0, 
i.e., oc p(x)dx and /i^ (j3_i)-i the lazy one, then for any Lesbesgue 

set A C [0, (/3 — the relation pp (p-i)- 

holds nil. 



i=l 

(60) 

since < C^^. (x) < [P — 1)^^- Both this decomposition 
of X and the contracted subinterval are obtained under the 
assumption of fixed v* and the onto-mapping property of the 
above three dynamical systems. 

We are now ready to study the contraction process of the 
interval with varying Vi e [1, (/?— 1)^^], 1 < i < L. Consider 
a "dynamical" version of Daubechies et aZ.'s proof IIT2I . lfT3l . 



JOURNAL OF MbX CLASS FILES, VOL. 6, NO. 1, JANUARY 2007 



g 



||T5l for the exponential accuracy of the /3-encoder containing 
the flaky quantiser with its threshold Vi, where at each iteration 
the value of may vary. Since the fluctuating Vi implies that 
each mapping is a kind of nonlinear "time-varying" system, 
we have to examine the binary sequences generated by the 
map and the exponential accuracy of the /3-encoder when the 
value of I' may vary at each iteration. 

Let /j pi (x) = \li{i'l),ri(i'l)), i > 1 be the ith interval 

by the Renyi ("cautious") map (x) (1 < i^^ < (/3- 1)"^) 
, recursively defined by 



Lemma 2:If x G pi (x), then x e /-^^ ^i+i (x), i E 

Z. That is, x is always confined to the ith subinterval where 
the binary digits of the [3-expansion of x are obtained. 

proof: It is obvious that x £ Io.Cf,,A^) — [^AP ~ 
1)^^) because x e [0,1) C /o,c^„(a;). Suppose that x e 
Ii.c^ .{x),i>l. 



(61) 



together with the initial interval lo^Cfj .A^) — ['oi'^o) with 
la = and ro — {/3 — 1)^^- This yields the relations 



,=1 P'^i 



(62) 



.r 



i=i 



which implies that if C\ (x) < 7t'i+i, i.e., b-^^ ^^i+i = 0, 

then X - = 7^C^^,(a;) > 0. Otherwise, i.e., if 

C\ ^>(x) > 7i^j+i, c-.+i = 1, then x - > 

7*+^(i/,i+i — 1) > since 1 < Vi^\. On the other hand, 

ri+\(y''A'^) - X 



Using the two trivial relations (/? — 1) ^ = Ejli T"* ' (/^ ~ 

1)"^ - Ej=i7^ = Y.%^+ll^ = iP - and we can 

rewrite ri{i'l) as 

oc 

= kii^l) + ^ 7-'" = + (/3 ~ l)-i7\ (63) 

Then, we obtain the useful relation 

\l 



i+l 



y+i{(/3 - l)-i + - /3C;,,j (x)}, 



which implies that if C^^i(a;) < 71/^+1, /.e., 6^^-^ 



> 



,+i,c'+i , (2;)! 

\kc^ .(^)l 

3^ 



(64) 



where |/| denotes the width of an interval /. Figures |6ta) 



'li '1 



s-i)-'r 


\"0" 






(^-i)-ir- 




V"" 












X 

010 








.V 














r 








r ■ 













■ 







0, then r,+i(;.l+i) - a; - y+i{(/3 - 1)-^ - /^C^^.-C^^)} 
7*+i{(/? - 1)"^ " > because < (/3 - X)-^ . 

Otherwise, i.e., if CI ^i{x) > 7J^,;+i, ^.j+i ^i+i = 1, then 

r,+i(^+i) - X = 7'+i{(/?- 1)"' + 1 -/3C;,,; (x)} > since 
C« {x) < (/3 — 1)~^- This implies that x G ^i+i (x). 
This completes the proof. □ 

j(3=1.5,i=16 



(a) 



Fig. 6. Repre.sentation of the /3-expansion process: the vertical bar with a 
scale represents the subinterval /i(-) at the ith stage, where Iq = [0, (/3 — 
l)""*^) is the initial interval. A succession of three binary decisions using the 
quantiser qI{-) gives two binary expansions of the sample x:{a.) 010 and 
(b) 110, each of which depends on v. The widths of the subintervals are 
contracted by 7 and renormalized. 



and (b) show two examples of the interval contraction process 
by /3-expansion, where the subinterval is marked with a scale 
that indicates several numbers and a renormalization rule is 
devised which is guaranteed by the onto-mapping C/s^i^{x). 
Furthermore, this yields the following important lemma. 
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threshold (v) 



Fig. 7. The MSE(x^ (7,Pl)), Pl e {0, 1} using the exact /3 of 

the /3-encoder with /3 = 1.5, L = 16, and fluctuating Ui, I < i < L with 
its several fluctuation bounds 0, 10, 20, 30, 40%. 
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Thus, we have obtained Eq.([35Tl. We differentiate between 
the choices of fixed i^*, e.g., the greedy /lazy and cautious 
expansions and the decoded methods of a sample x. However, 
the roles of "0" and "1" should be equal in the binary 
expansion of a sample x. Theorem 1 supports this simple 
intuition which is an elementary result but is a fundamental 
point for this study. Furthermore, Lemma 2 readily leads us to 
a good decoded value of x, i.e., the "midpoint of the Lth stage 
subinterval ql (x) with Vi £ [1, 1 < i < L", 

denoted by a; (7, 1), and defined by 



x(7, 1) 



L 

i=l 



7^(/3-l)- 



(65) 



This works in favour of the cautious expansion with its 
strongly invariant subinterval of the locally eventually onto- 
(cautious expansion) map ^,{x), J^™™' (x). 

Hence we readily obtain the following important theorem: 
Theorem 2 II28I : /f we introduce different decoded values of 
X, depending on the representative point in the Lth subinterval, 
denoted by the index pl as follows: 



(7, Pi) = < 



if PL ^ I, (66) 
if PL ^2, 



h,c^ , (7, Pi) I < 



il + \pL-l\) 



-17^. 



(67) 



Proof. Since x £ [/^(z^f ), ri(z^f )], the approximation error 
is bounded by 



Xl,c^ , (7, Pi) I < 



(/3 

(/3- 



if PL = 0or2, 

if PL ^ 1. 

(68) 

This concludes the proof. □ 
Remark 2: Theorem 2 demonstrates that the decoded value 
of X using {6j (ji }|Li should be defined by (7, 1). 

On the other hand, ql (7, 0) is identical to the decoded 

value of Daubechies et al. Namely, Xj^ (7, 1) improves 

the quantisation error by 3dB over the Daubechies et al.'s 
bound i^7^ fl3l when (3 > 1.5 since 



- .(7,l)l< 



^<7^<z/7^. (69) 



These observations are clearly confirmed in several numerical 
results of the mean square error (MSB) of Xj^ (jl (7,1) using 

(3 as shown in Fig|5]and those of estimated (3 as shown below 
in Fig|8]as well as those of Xj^ ql (7, 1) using estimated f3 in 

FigH] Figure |5] shows the MSB of quantisations by decoded 
^LC^ (.ItPl), < < 2 using the value /3 = 1.5 of 

the /3-encoder with L = 16 for fixed 1^* £ [1, (/? - 1)"^]. 
It is clear that the MSB of the decoded ^ by the 



cautious expansion is smaller than those of the greedy and 
lazy expansions because of their invariant subintervals (see 
Figinia)). 

In all of the numerical simulations as discussed below, we 
average over 10, 000 samples x, which are assumed to be 
uniformly and independently distributed over [0, 1] for 100 
thresholds £ [1, {(3 — 1)^^] with its associated fluctuating 
thresholds j/;, 1 < i < L based on the fluctuations Ui, i.e., 
Vi = v*{l + Ui) where Ui is an independent random variable 
with bound e £ {0, 0.2, 0.3, 0.4}. We introduce the mean 
squared error (MSB) of the decoded Xl,c^ > defined as 



MSB(J^ , 



{x — Xi 



L.C^ 

' 



fdx. 



(70) 



Figure I2] shows the MSB(a;^ pi {■^,Pl)),Pl G {0, 1} using 



the value of /3 for the fluctuating Vi, 1 < i < L with its 
several fluctuation bounds. 



p = 1.11111,1=1,2 



then at L-bit precision, the approximation error between the 
original value x and its decoded value Xj^ql {"^tPl) is ^ 

bounded by 
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Fig. 8. The MSB of the estimated /3, i.e., I3j^ (^l {x, 0), P^ ql ^ {x, 1), 



and /3r 



{x, 2) of the /3-encoder with /3 = 1.77777, L = 32, and fixed 



u* e [l,(/3-l)"i]. 



V. Characteristic equations for /3 

In order to show the self-correction property of the amplifi- 
cation factor (3, Daubechies et al. ifTSi gave an equation for /3 
governed by the bit sequences of the sample data as follows. 
Using the /3-expansion sequences &j for x £ [0, 1) and 

Cj c' for y = 1 — X (i = 1, 2, • • • , L) yields a root of the 

characteristic equation of p, defined by 

L 

1=1 



as the estimated 7. In order to apply Daubechies et al.'s 
idea for estimating (3, let us introduce cautious expansions 
{^i c' }i=i foJ" ^ c' }i=i foi" y — 1^2^- Let us use 
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Fig. 9. The MSB of quantisations by decoded Xj^ ql (7i 0), 
ql (7, 1) and Xj^ ql (7, 2) using the estimated (3 of the /3-encoder 
with P = 1.77777, L = 32,''and fixed u* G [1, (P - 1)"^]. 
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Fig. 10. The MSB of the estimated /3, i.e.. (3^ „l {7, 1) and 
f^L il'^) °f the /3-encoder with /3 = 1.5, L = 16, and fluctuating 

Vi, I <i < L with its fluctuation bounds 0, 20, 30, 40%. 



Eq.(l66]l to define the decoded values, respectively as follows: 

fi.^t ^ 2(1-7) 

L 



yL,c^ , 



il, Pl) = y]ci,C' f+PL- 



L+1 



2(1-7)- 



(72) 



Then we get the relation 



which gives a new characteristic equation for 13: 



1 (73) 



Big. 11. The MSB of quantisations by decoded Xj^„l (7i 0) 

and x^ (7, 1) using the estimated /3 ('.e., (7, 0) and 

I^L ^) °^ ''^^ /3-encoder with /3 = 1.5, L = 16, and fluctuating 

Vi, 1 <i < L with its fluctuation bounds 0,20,30,40%. 



Theorem 3 |28|:r/ie estimated value of j is a root of the 
polynomial P]^ (J L {■j^pl), defined by 



-7 

(74) 



The uniqueness of such a root of the continuous function 
{ItPl) over the interval [0,1] is guaranteed by the 



intermediate value theorem since 



Xi^pl) 



< 0. Let 

£17 

Pl (^) the root of ^i, {'^tPl) as a function of 
the sample x, which is uniformly and independently distributed 
over [0, 1]. We introduce the MSB of the estimated ^i, , 

defined as 



(/3-/5l,c- ,fdx. 



(75) 



Remark 3: Daubechies et al.'s characteristic equation of /3, 



Eq.dZB [15], i.e., P 



'Daubechies et al. 



(7,0) has no term 7^+^(1 

7)"^ that can be written as the sum of two terms 7^+^ [2(1 — 
7)]"^ of the decoded values Xj^ and , which 

come from j'^C^ ^^{x) and 7^C^yt(l ^ a;), respectively. 
However, this missing term 7^+^ [2(1 — 7)]^^ plays an impor- 
tant role in estimating both /3 and x precisely, as shown below. 
Thus, this term should not be removed because information 
will be lost. This is one of the main differences between 
Daubechies et a/.'s DA conversion in the /3-encoder and ours 
defined here. 

Remark 4: In a decoding process, knowing the exact value of 
a fixed e [1, (/? — 1)~^) is unnecessary. If one wants to 
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know the estimated v*, it is given by 

L 



Ic,^. (7, 1) = E\c.,„.f + (76) 

i=l 



which comes from exchanging the roles of a; and v. 

Figures |8] and |9] show the MSE(/3^ pi {x,pl)) and 

MSE(a;^ pi (7,^^)), respectively, for < pl < 2, using 
the estimated /3 of the /^-encoder for fixed v* . Comparing 



Fig|5] with FigH] leads us to observe that 



{IiPl) 



gives a better approximation to x than Xj^(jl {'^^Pl) in 

terms of the MSE performance. Figures [TO] and [TT] show 
the MSE(/3ic'L and MSE(xi ^i, (7,pl)), re- 

spectively, with pj^ E {0, 1} using the estimated /3 of 
the /3-encoder with fluctuating i^i, 1 < i < L with its 
several fluctuation bounds. As shown in Figs. |7] and (TT] 

^LC^ (ItPl), PL G {0,1} also gives a better approxima- 

tion to X than Xj^ ql {j,Pl) even in the case of fluctuating 



VI. Optimal design of an amplifier 

WITH A SCALE-ADJUSTED MAP 

In /3-encoders, for a given quantiser tolerance <t < {(3 — 
1)^^ — 1, we must choose appropriate values for the quantiser 
threshold and the amplifier parameter (3. The scale of the 
map depends solely on f3 which determines the MSE of the 
quantisation. This motivates us to introduce a new map, called 
a scale-adjusted map, with a scale s > independent of f3, 
defined by 



(3x 



X e [0,71/), 



Sg V six) — S a ' in 1 N ' \ V E \s{Q — 1), s), 

ill) 

which is illustrated in Fig. [12] This is identical to the 13- 
map when s = (/? — 1)^^- Let 6^ ci be the associated 

bit sequence for the threshold sequence i^f , defined by 



0, S'-y, ^{x)E[Q,iv{), 

The scale-adjusted map Sp^u,s{x) also determines the 
flaky quantiser Qj^j^-^) s^jl')- The invariant subinterval of 
Si3m,s{x), defined as [v— s{(3— 1), sv) is similar to that of the 
/3-expansions. Let {h^ gi be the sequence generated by 

iterating the map Sfi v six) oi x £. [0, s) L times, denoted by 

P.iy^.s^ 



..L ..ix). Then we get 



(x) 



(3S 



L-l 



,ix)-s{P~l)bL,s,, 



= (3'^x-siP-l)Y,Ks,,^.j' 



or 



x = si(3-l)Y,Ks^^ 

i—1 



(79) 



(80) 



Using the relation ^ix) G [0, s) gives its subinterval, 

defined by 



L,S^ , ix) 



7 



L + l 



which enables us to easily obtain the decoded value Xj^ g 

I 

as follows: 



Xl,S^ 



S7 



i=l 



and its quantisation error bound as 



^ix) = |a;-Ji_5L I 



< 



S7 



(82) 



(83) 



We introduce an A/D converter, called a scale-adjusted (3- 
encoder, that realizes the above expansion, as shown in Fig. 
[T3I where the scale s of S/s^^^s can be adjusted with the 
bit-controlled constant-current source of the quantiser s{b), 
defined by 

'0, 5 = 0, 



sib) = 



(84) 



Its robustness to the fluctuation of the quantiser threshold 1/ is 
restricted by its tolerance (Jp^s- 



'J/3,s = s-s(/3-l) = s(2-/3). 



(85) 



Even if the amplification factor (3 is constant, the tolerance 
(T/3 s can be set arbitrarily by selecting the constant-voltage 
source s. We get the following convenient lemma as a rule of 
thumb for AD/DA-converter designs. 

Lemma 3: In a scale adjusted (3-encoder, for a given bit 
budget L and quantiser tolerance (7/3, s, the amplification factor 
[3 with its inevitable fluctuation, should be set to 

2L 

in order to minimize the quantisation error 
proof: Eq.dlB gives 14 ql (x)| = sf3 



ap,s(3-'' 
(2-/3) 

Differentiating |/^ gL {x)\ with respect to /3, we obtain 



d\f 



ix)\ 



^P,s(3' 



-L-l 



dp 



(2-/3)2 



-{/3-L(2-/3)}. 



(87) 



This completes the proof. □ 
This lemma shows that the amplification factor (3 minimiz- 
ing the quantisation error is not equal to 2 but the relation 
(3 = 2 as in PCM holds only as i 00. However, 
we must take a little care at this point. Assume that for a 
given initial value of an A/D converter x £ [0, 1), the scale 
s — <7i3,siL + l)/2 > 1. In this case, we should adjust 
the amplification factor and the constant-voltage source which 
satisfy /3 = 2L/(i+ 1) and s = ai3^siL + l)/2, respectively; 
otherwise we should adjust these parameters such as s = 1 
and /3 = 2 — = 2 



'I3,s- 
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3(1-7') I r V s 



Fig. 12. The scale-adjusted /3-map 5^ „ ^(a;) with its invariant subinterval 

[v- s{(5~l),v). 



coTstart-voltage source 





° / f '5s-!/ sr s 
s(1-r) vr 



Fig. 14. The map of the negative /3-expansion:Rg ,^ ^ (x ). Its invariant 
subinterval is a function of u (see Figs. [T6ja),(b),(c) and ll7r b)). 



,NR constant current source 
If fcj+i = 1 I — ^ — r 



Fig. 13. The scale-adjusted /3-encoder, where s = s(b) is defined by Eg. 184) . 




Delay j* (-{- 



VII. Negative /3-encoder 

This section introduces a radix expansion of a real number 
in a negative real base, called a negative (3-expansion, and dis- 
cusses differences between the quantisation errors of negative 
/3-expansions and those of (scale-adjusted) /3-expansions as 
well as their MSE. Such a negative radix expansion is unusual, 
and somewhat intricate. First, consider a (scale-adjusted) neg- 
ative /3-expansion as a map Rp^^^six) : [0, s) [0, s), s > 0, 
defined by 



Fig. 15. The negative /3-encoder. 



represented recursively as follows: 



s — f3x, X e [0, jv), 
(3s — f3x, X € [71^, s), 



V e [s(/3 - 1), s] (88) which yields 



as shown in Fig. [14] Such a negative /3-expansion defines a 
new A/D converter as shown in FiglTS] called a negative /3- 
encoder which facilitates the implementation of stable analog 
circuits |f] and improves the quantisation MSE both in the 
greedy case v ~ s(/3 — 1) and in the lazy case = s as 
follows. Let 6j j^i {x) be the associated bit sequence for 

the threshold sequence v^, defined as 



where 



1 + 



(/3-1). 



(91) 



(93) 



The relation € [0, s) defines its subinterval. 



(x) 



0' ^ir.'i-,^^''^^ t^'^''^^' 

1, R'-^l,[^{x)eh,^.,s), 



2L+1 



2L+1 



(89) 



=4-1'''^'- ■ (-7r,-E4«' . (-7)') 



fi,./!, 



where i?^ ^(a;) is defined recursively as 



(94) 



2L 



2L 



(90) 



The scale-adjusted negative /3 map Rp^u.s{x) also defines 
the flaky quantiser Then can be 



which enables us to obtain the following decoded value 



'Personal communication with Prof. Yoshihiko Horio. 



= s{(-7)V2-E4«'. . (-7^}- (96) 
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Then, its quantisation error pt (x) is bounded as 



j^'{s - Rfy^e/x)} > because Rf^.,^^{x)) < s. 
This implies that x E a^^+i (a;). 

(97) Similarly, suppose that x £ 1 2^-1 a^^-i {x). Then, 



which is the same as in the scale-adjusted /3-expansion. 

Such a successive approximation of x by the cautious 
expansion using //f is described by the contraction process 
of the interval by the negative /3-expansion as follows. Let 
Ii R' (x) = K^(t^i)'''j^(^i))' «> 1 be the ith interval for 
the negative /3-expansion map i?^ ^(a;) with the threshold 
sequence i/J, (s(/3 — 1) < i^j < s), recursively defined by 



x-l^ei-r) 

21-1 r,2l-l 



21-1 



jR (^2e+i) 



'■2e+i 

^R („2e+i^ _ 



2e 

+ sY,Ar' . i-iT 



(-7)' 



i? 



2£-l 



-1 (x)}, 



2e+i,R^ 



7), 



= /2Vi(^r')+'^7''-ni- 7), 



Thus, we have the following lemma. 



2.-i«"^) + ^7^'(l- )■ 

(98) 



Lemma 4: // 2: S /, 



[x), then X 



I, 



i+l,i? 



+1 (a;), z e Z. 



proof: It is obvious that x G /o,i?,3 „ ^ (x) — [0, s) because 
X S [0,1) c /o flfl {x)- Suppose that x € I^ir^'^ (2^)- 
Then, 



^ '2^+1 ('^i ) 



2« 



i=l 



4K'') + S7^'+^(l-/2,+i. 



2^+1/ 



7'ni?a.-,.(^)+^7(l-/2,+i 



)}, 



which suggests that if Rf .i Ax) < li'2i+i,i-' 



1, then X - 



^^^.2. ^3 (a:) > 0. Otherwise i.e., f^^^^ j^^t+i^^^ = (3, 

X - l^i+iivi""^) > 7^^+H'^2«+i - s(/3 - 1)} > because 
'^2£+i > — !)■ On the other hand, 



^^2^+1 



21 1 



2£+l,i?^ 



7) 



2^ 



1=1 



^7^^+V2.+i,«-i,, -7^^i?^!.2.Ja:) 



2f r>2l 



7 {s7/2£+i./ 



2<? 



which suggests that if jjH. J\x) < ^V2i+i, i.e., 

f2i+i.R''\\^, = 1' then - x > 

72^+^(5 — 1^2^+1) > because i'2i+i < s. Otherwise 

i-e., f2i+i,R^ = P, r^ni^i^'"^) ~ ^ > 



which suggests that if R 2i-i{x) < ^1^21, i-e., f2e r^<' = 

1, then X — = 7^'^(s — V2i) > because i'2e < s. 

Otherwise /.e.Jaf.fl.^* ^ (3, x ~ l^^ivf) = -^^^'^{s - 

R^^^2i 1 (a;)| > because R^^^2t 1 (a;) < s. On the other 
hand. 



' 2^-1 



(.r^)+-7^^(i- ) 



2^-1 



+ 7 



l''-'{si{l-f2e,ii- 



' ^- ')Vi??/-2L. (a:)}, 



which implies that if R^J^ 21.-1 {x) < ^V2i,i-^-'f2tR^' = 
1, then rg(i^f , s) - a; = ^l'^'^'^ R^^^2i-i ^{x) > 0. Otherwise, 

because s(/3 — 1) < i^2«- This implies that x G I21 021 ^(a;). 
This completes the proof. □ 
Similarly, using the idea of Daubechies et al. and the 
negative /^-expansion sequences b^ ni for x and q 

for y = 1 — a; (« = 1, 2, • • • , L), we can get the characteristic 
equation of /3 in a negative /3-encoder as follows: 



L.i?^ , (7) 
L 

i \ " 



1=1 



'i,R^ 



}(/3-i))(-7r}-i 



L-l 

-T.i^-d^.R' . +rf.+i.fl'+^, ](-7)^}-l 

i=l 



where d. 



'i,R^ 



^i.R' + _Ri 



(99) 

However, it is hard 



to guarantee the uniqueness of the root of Eq.(l99]l. 

The invariant subinterval of the map i?^,^ ^(a;) consists of 
2 line segments as shown in Fig [14] The line segment in the 
graph of Rp.u,s{x) with the full range is called a /m// line 
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segment. There are three possible cases as follows: 

1) The right segment is the full line segment (as shown in 
Fig. [T6l a)) whose invariant subinterval is given by 



when (/3 — l)s < v < 



[Pv - {13^ - I3)s, 13s - v) 
13'' -13 + I 



(100) 



^+1 



-s since 




I3s-v-^{[3v~ [0^ - I3)s} > 13s - V - {s - v} 
^ {13' - l3 + l)s-{(3+l)v>0 



(t>) 



13' -13+ I 
13 + 1 



Fig. 17. Invariant subinterval, a function of v, in (a) an ordinary /3-expansion 
(see Fig|4ja),(b)) and (b) a negative /3-expansion (see Fig |16l a).(b).(c)) . 



2) No full line segment (as shown in Fig. [T6l b)) whose 
invariant subinterval is given by 



Negative j3 encoder (/3 = 1.5, i=16) 



[s -v,(3s- v), 

P'-p+l ^ 2(3-1 
when — : — s < v < — — —s since 



(101) 



1e-006 



13+1 - 13+1 
-{s-y)^{l3-l)s 
^ (2/3- l)s > (/3+ 

2(3- 1 
<^ I' < — — -s. 



Ps-„-{s-,.)^{(3-l)s>Pi.-{f3-l)s-is-:.) ^ ^^^^^ 



(3+1 

3) The left segment is the full line segment (as shown in 
Fig. dStc)) whose invariant subinterval is given by 



[s-,y,p,y-s{(3-l)), 



(102) 



2(3-1 

when s < v < s since 

(3+1 - - 



(3v-{(3- l)s - {s -v}> (is-v- {s-v) 

^ {(3+l)v-{2(3-l)s>Q 
2(3-1 



(3+1 



■s < y. 



-a 



o 
LU 

CO 2e-007 



1e-007 











e 
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exact 
flaltyS 


p flakj 
1% i 
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jxact^ 
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d V 























1 1.1 12 13 1.4 15 Ifi 1.7 IS 15 

threshold (v) 



Fig. 18. The MSE(5;^ (7, 1)) using the exact /3 of the negative 

/3-encoder with f3 = 1.5, L = 16, and s = (/3 — 1) for fluctuating 
Ui,l <i < L with its fluctuations 0, 20, 30, 40%. 




Fig. 16. Negative /3-expansion map Rp y ^{x) with its invariant subinterval 

h ,Wfl 1^ ^ /32-J3 + 1 (fi-(i+\ 2/3-1 
when (a) (/3 — Ijs <v< ^ s, (b) : s <v< 

2/3-1 

and (c) s < v < t 

/3 + 1 - - 



/3 + 1 



Since the quantisation error in the /3-expansion is bounded as 

^L,s^ , {x) = \x-Xl sl {x)\=1^\^- S^^l ^{x)l 

(103) 

*In the /3-expansion, the greedy-expansion map (or the lazy-expansion 
map), restricted to its invariant subinterval has a left (or right) full line segment 
as shown in Fig|4](a) (or (b)) but the cautious-expansion map, restricted to 
its invariant subinterval has no full line segment as shown in Fig[3](a). 



1e-006 



Negative /3 encoder (/3=1.5,£=16) 



T 



3 1e-007 



O 
LU 



1e-008 




1.3 1.4 15 15 

threshold (v) 



1.7 \B 



J (7, 1) of the negative 



Fig. 19. The MSE of the estimated /3, i.e., /3^ 

/3-encoder with /3 = 1.5, L = 16 and s = (/3 — 1)~^ for fluctuating 
Vi,l<i<L with its fluctuations 0, 20, 30, 40%. 
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Negative /3 encoder 5, i= 16) 



j3=1.5, i=16 
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1 L1 12 1.3 1.4 15 1£ 1.7 IB 15 2 

threshold (v) 



1e-006 



< H 



O 
LU 



1e-007 



1e-008 




1 1.1 12 13 1.4 15 1:6 1.7 IB 15 2 

threshold (v) 



Fig. 20. TheMSE(x^^^t ^ (7, 1)) using the estimated /3 of the negative Fig. 22. The MSE(J^ ^i, (7, 1)) (or MSE(i^ ^i, (7, 1)) using the 



/3-encoder with f} = 1.5, L = 16, and s = (/9 - 1) ^ for fluctuating estimated /3 of the /3-encoder (or the negative /3-encoder) with (5 = 1.5, 



i/i, I <i < L witii its fluctuations 0, 20, 30, 40%. 

13 = 15, L= 16 
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threshold (v) 



IB 15 



Fig. 21. The MSE(x^ (7, 1)) (or MSE{J^ (7, 1)) using the 

exact j3 of the /3-encoder (or the negative /3-encoder) with /3 = 1.5, L = 16, 
and s = (/3 - l)-i for fixed 1^* e [1, (/3 - l)-i]. 



L = 16, and s = (/3 - 1)-^ for fixed i/* e [1, (/9 - l)~i] 

= 1.5,i=16 
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threshold (v) 
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Fig. 23. The MSE of the estimated /3, i.e., ^ (7, 1) ( or 

('y^ °^ /3-encoder (or the negative /3-encoder) with a fixed 
u* G [1, (/3 - 1)^1] for /3 = 1.5, L = 16, and s = (/3 - l)-^ . 



the MSE of the quantisation decreases if Sp^u_s{x) frequently 
takes on values in the middle portion of the interval [0, s). It 
is natural to assert that the quantisation threshold v (with the 
inevitable errors) should be designed to be nearly equal to 

V = l3s/2 (104) 

so as to reduce the quantisation MSE (see 
Figs. S H E m [ini [IB. 

The invariant subinterval in the /3-expansion given as 
[z^ — s(/3 — 1), J/) as a function of v is illustrated in Figure 
[TTl'a). where the /3-expansion is here called the ordinary 
/3-expansion in order to discriminate between the /3-expansion 
and the negative /3-expansion. Hence the MSE becomes lower 

when V — — since the invariant subinterval is given by 



[(1 — — )s, — ). Meanwhile, the MSE in the greedy expansion 

(v = .s(/3 — 1)) (or the lazy expansion = s)) increases 
because the invariant subinterval is given as [0, (/3 — l)s) (or 
[s{2 — /3), s)), which is skewed towards the left (or the right) 
portion of the initial interval [0, s) as shown in FigfTTla). 

On the other hand, the invariant subinterval in a negative 
/3-expansion as a function of ly is illustrated in Figure [TTl b). In 
particular, both of the greedy expansion and the lazy expansion 
have as their invariant subintervals, given as [0, s), which is 
the same as the initial subinterval. Therefore, the quantisation 
MSE automatically becomes lower compared to that of a 
/3-expansion, while the invariant subinterval in a negative 
/3-expansion with ly — I3sl2 is given by [s(l — /3/2), /3s/2], 

/3s 

which is the same as in a /3-expansion with v = — , 
so the MSE is comparable. Figures [18] and [19] show t^e 
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MSE(x^ oi (7,1)) using the exact (3 of the negative 
/3-encoder and the MSE(/3^ (x, 1)), respectively, with 

(3 = 1.5, L ^ 16, s^{(3- l)-i for fluctuating z^i, 1 < i < i 
with their several fluctuation bounds. Figure |20] shows 
the MSE(a;^ oi, (7, 1)) using the estimated (3 of the 

negative /3-encoder Comparing Fig|T8] with Fig|20] shows 
that Xj^ (7, 1) gives a better approximation to x than 



(7i !)■ Figure |2T| shows the MSE(2;^ 

(or MSE(x^ Di (7, 1))) of quantizations using the exact 

(3 of the /3-encoder (or the negative /3-encoder). Figure l22l 
shows the MSE(xi ^i, (7,1)) (or USE[xl j^l (7,1))) 

using the estimated [3 of the /3-encoder (or the negative 
/3-encoder) with (3 = 1.5, L = 16, s = (/3 - l)-i for fixed 
V* e [l,(/3 - 1)-!]. Note that the USE{xl^c^ ^(7,1))) 

is smaller than the MSE(2;^ (7, ij)^ even 

though the MSE(/3^ pt (x, 1))) is smaller than the 
MSE(/3i pi, (x, 1))) as shown in Fig|23] 



(7,1)) 



VIII. Markov chain of binary sequences 

GENERATED BY /3-ENCODER 

As discussed above, the localized invariant subinterval 
makes the quantisation MSE in greedy/lazy-expansions worse 
than that of the cautious-expansion. Regarding a binary se- 
quence generated by the greedy/lazy and cautious expansions 
as a Markov chain generating binary sequences, we show an- 
other clear distinction between them. Furthermore, we observe 
that such a Markov chain explains the probabilistic behavior of 
the flaky quantisers, defined by the multivalued Renyi maps. 
First, let us notice that there is a close relationship between in- 
formation sources and a Markov chain with a transition matrix 
of a finite dimension [35|. The /3-expansion maps, however, 
are not easy to characterize by transition matrices of size 2 
except for the original Renyi map with [3 — {1 + V5)/2. 
Consider a special class of piecewise-linear Markov maps sat- 
isfying conditions l)-4) of Definition 1, in which in addition, 
each t\i. is required to be linear on li ifTSl . Such a map 
simply provides a transition probability matrix. 0Kalman [3T1 
gave a deterministic procedure for embedding a Markov chain 
into the chaotic dynamics of the piecewise-linear-monotonic 
onto maps. Several attempts have been made to construct 
a dynamical system with an arbitrarily precribed Markov 
information source; in addition, by analogy with chaotic 
dynamics, arithmetic coding problems are also discussed |32l, 
||33|. The relationship between random number generation 
and interval algorithms has been discussed in |[34l . However, 
the few attempts or discussions in the following decades 

'This value is a root of 7 = /3 — 1, which comes from the sufficient 
condition for the greedy map to be a two-state Markov map for the partition 
{[0,7), [7, 1)}, i.e., the maps [0,7) ~> [0, 1) and [7, 1) ~> [0, /3-1) satisfy 
the two-state Markov property (condition 3)) of Definition 1. 

*Ulam [29] posed the problem of the existence of an absolutely continuous 
invariant measure for the map, known as the Ulam 's conjecture, and defined 
the transition probability mafiix. See the Appendix for detail. 



remind us that Kalman's embedding procedure, as reviewed 
in the Appendix, is to be highly appreciated in the sense that 
Kalman addressed the question of whether irregular sequences 
observed in physical systems originated from determinism or 
not. 

We turn now to the cautious expansion map C/3.y(x)|[jy_i j^), 
consisting of two line segments Cp^u{x)\^jj_i,y^-^ and 
C'/3,i/(a^)|[7iy,i/)- The inevitable fluctuations of (3 and v 
in an analog AD-conversion, however, prevent the map 
C'/3,i'(a;)|[i/-i,i/) from being a two-state Markov map for the 
partition {[v — 1,71^), Yiv, v)}, i.e., the maps [v — 1,7J^) 
[(3{v — l)^v) and Y^v^v) — > [0,l3v — 1) do not satisfy the 
2-state Markov property (see FiglSja)). This situation compels 
us to introduce an approximated transition matrix of size 2 
representing a 2-state Markov chain [28] induced by the map 
C'/3,,y(a;)|[j,_i as shown in Fig|3la) as follows. 
A detailed observation of Fig|3ja) reveals that Ci3^y{x) < 
'yiy, whenx G [ly—l, h"^'^) 01 x G [2^7,1/7^+7) and Cj3,t^{x) > 
'yiy,whenx G [z^7^, 1/7) orx g [2^7^ + 7,2^). Hence for 
/32 

this map Cp,i^{x) gives the following 



/3 



< i/ < 



/32 - 1 - /32 
conditional probabilities: 



Pr[X„+i = 0|X„ - 0] 
Pr[X„+i - 1|X„ - 0] 
Pr[X„+i = 0|X„ = 1] 
Pi[Xn+i = 1|X„ = 1] 
5(^) 



{v-X) 
1/7 — i/7^ 

— (y — 1) 

V — v^"^ — 7 
V — 



= 1 
1 



1 



PU{V) ' 
1 



f3u{uy 



where U{v) 



T{v) 



(105) 

S{u) = iy{f3 - 1) > 0, and T{iy) ^ 



V — (3{v — 1) > 0. These propabilities define the transition 
matrix as follows: 




U{v) 















U{u) 















forzy < 



, for 



^t(106) 



1 

1 - 



1 



, foxv > 



/32-1 ' 



whose stationary distribution is defined as 
(Pr[X = 0], Pr[X = 1]) = (moo, 1 - 

^ .(/3rH, 

{T{v), pS{v)) 



S{y)- 


h (3T(y) 




1 








1 



for 2/ < 



[T{u)+/3S{u) 



/32 - 1 
fori/ > 



<v < 



1' 



0' 



P^ 



P^ 



/32-I' 
(107) 
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and whose second eigenvalue X{/3, v), besides 1, is given as 



A(A z.)=<i 1 - ^ (C/H + [/-^H) , for 
1 



/32 



1 



< 1/ < 



1' 



foxv > 



/32 



1 



/32 



The second eigenvalue is bounded as A(/3, v) <1 
/3 / . 



/3 



1 

(108) 

< 



if 



<v < 



(or A(/3, i^) < otherwise). 



/32 - 1 - /32 - 1 
For the greedy case {v — 1), we have A(/3, 1) = 1 — 
/3-H/3 - 1 + (/3 - 1)"^) and (Pr[X = 0], Vx[X = 1]) = 
(l; (/3 ^ 1)^); while for the lazy case {v = {fi — 
we have A(/3, (/3 - l)-^) = A(/3, 1) and (Pr[X = 
0], Pr[X = 1]) = (1 + /?^)"^ (/32, 1). The second eigenvalues 
A(/9, ^) illustrated in Figl24lshow that for almost all j3 and v, 
P{P, v) has a negative eigenvalue of large magnitude except 
in the cases with (3 = 1 and /? = 2. To confirm this 
fact, we introduce another method for estimating the non-unit 
eigenvalues of a two-state Markov chain as follows. 

Let 6i, 62, ■ ■ ■ be a binary sequence generated by the 
/3-encoder. We regard {6;} as a two-state Markov chain with 
transition matrix P{{nij}) ll28l . defined as 



"00 



noo+noi 
"10 



"01 



"oo+noi 
"11 



(109) 



"lO+nil nio+nil 

where noojJ^oijnio and nn are frequencies defined as 



"00 = Yln=l bi ■ b, 
"10 = Y.f=~l^ ■ 



rill 



•fej+i, 



(110) 



Such a matrix P({ny}) enables us to estimate the second 
eigenvalue A provided that iV is a sufficiently large number 
e.g. N = 100, 000. The results illustrated in Fig|25]show that 
almost all the eigenvalues are negative and that the value A 
of the greedy (or the lazy) scheme is larger than that of the 
cautious scheme for almost all (3 and u. The negative non- 
unit eigenvalue of the transition probability matrix of size 
2, P{P, I') plays an important role in designing spreading 
spectrum codes generated by a Markov chain with its negative 
eigenvalue in an asynchronous direct spread code multiple 
accesss system to improve the bit error performance ll36l . ll37l . 

JMl. 

IX. Conclusion 

The /3-expansion has been shown to be characterized by the 
process of contraction of the subinterval containing a sample 
X. This has led to the following three results: (1) the new 
characteristic equation of the amplification factor /3 provides 
decoded values of and a sample x with high precisions; 
(2) the negative /3-encoder improves the quantisation MSE 
in greedy/lazy schemes; (3) if a binary sequence generated 
by the /3-encoder is regarded as a two-state Markov chain, 
then the second eigenvalue of the Markov transition matrix is 

'The reader interested in chaos-based spread-spectrum communication 
should see the review paper (35 | 



negative, and the absolute value of the eigenvalue is larger in 
the cautious scheme than in the greedy/lazy schmes, which is 
relevant to the precision of the decoded values of both (3 and 
X. However, it remains unknown why the value of x decoded 
using the estimated value /3 gives a better approximation to x 
than that using the exact value (3. In addition, the relationship 
between the quantisation MSE and binary sequences, approx- 
imated by Markov chains with the transition matrix having its 
negative eigenvalue has been omitted here because the MSE 
as a function of (3 and i' is complicated even for the transition 
probability matrix of size 2, P(/3, i/). In general, /3-expansions 
need more sophisticated discussion using a Markov chain with 
a transition probability matrix of size more than 2, which is 
an important problem for future research. 

Appendix 

Kalman's procedure of embedding a Markov chain 

INTO A nonlinear MAP 

Given a set of states S = {1,2, Ns} and a probability 
transition matrix P = {pij}fj^i, satisfying py > for all i, 

we define a sequence of random 
taking values in S. If Zq has an arbitrary 
distribution 



E^iPij = 1 for all i 
variables Zq, Z\ 



Pr{Z„^ 



Sk\ZQ 



(111) 



then the sequence of random variables Zq,Z\,... is called 
an A^s -state Markov chain. Given a Markov chain Zq,Z\,. . . 
and a function / whose domain is 5* and whose range is 
an alphabet set F = {71,- •• ,7w„}, and assuming that the 
initial state Zq is chosen in accordance with a stationary 
distribution u = [u\, ■ ■ ■ , uatJ, then the stationary sequence 
Xn = f{Zn), n = 0,1,2,... is said to be the Markov 
information source. In this paper, for simplicity, we take 
T — S, Na — Ns, and / to be the identity function. 

Kalman gave a simple procedure for embedding a Markov 
chain with transition matrix P = {Pij}fj^i, satisfying 



< pij < 1 for all i,j 



(112) 




Fig. 24. The second eigenvalue of the approximated transition probability 
matrix P(/9, u) as a function of 13 and i/. 
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into an onto Piecewise-Linear Map (PLM) map r : J = 
[0, 1] J with N"^ subintervals, defined by 

UJn+l = T{uJn), n = 0,1,2,..., Ll!„ ^ J (113) 

as follows. 

First divide the interval J into iV^ subintervals such that 
J = Uj^'i Jii where 

Ji = (di-i, di], do = < di < d2 < • • • < rfw. 1. (114) 

Furthermore, divide the subintervals Ji (1 < i < Ng) into 
Ns subintervals such that Ji = [jf^i Ji.j, where 

dij] for T{di) = 1, 
(di,o = di_i, di,Ar^ = di), 

(djj,d,j_i] for r(d,) = 0, 
{difi = di, di^AT, — di_i), 

subject to the conditions of a Markov partition, 

r(d,) e {0,1}, forl<i<iV, 
T(dij) = dj, for 1 < i, j < TVs, 

and the condition of the transition probabilities 



(115) 



(116) 
(117) 



for \<i,i <Ns 



(118) 



Thus, the restrictions of Kalman's maps t to the interval j, 
denoted by are of the form 

I Ji|w + (djjdj_i - dj.j_idj) 



I J, 



2 J I 



(119) 



10 



oj e Ji.j for T(di) = 1, 
-| Ji|a; + {dij-idj - dj^-jdj-i) 

oj £ Jij for T{di) = 0. 



Readers interested in Ulam's conjecture, and Kalman's procedure as well 



as its revised version should see 1351. 
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Fig. 25. The distribution of the second eigenvalue of the approximated 
transition probability P{{nij}) as a function of /3 and u, for A'^ = 100, 000 
and X = u — n/10. 





(a) (b) 
Fig. 26. An example of Kalman maps with (a) 4 and (b) 3 subintervals. 

For simplicity, consider the case where Ns — 2 and define the 
N'? X N'? matrix 



P = 



Pll 


Pl2 














P21 


P22 


Pll 


Pl2 














P21 


P22 



(120) 



Let A(P) be the set of all eigenvalues of P. Then we get 



A(F) = A{P) U 



(121) 



where P is an Ng x A'^s matrix with Ng = 2, defined by 



P = 



(122) 



Pll Pl2 
P21 P22 

Equation (1121b implies that a Markov chain is embedded into 
the chaotic map t{uj) = {Tij{Lu)}^j^j^. Figures l26l' a) and (b) 
show an example of the Kalman map with 4 subintervals and 
a revised one with 3 subintervals, respectively. 
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